Method and apparatus for requesting data, and method and apparatus for obtaining data

ABSTRACT

Disclosed herein are methods and apparatuses for requesting and obtaining data, in which time information is generated by use of a first device, and a data request command requesting data output by a second device is generated at a time point indicated by the time information. The generated data request command is transmitted, wherein the data request command includes the time information.

PRIORITY

This application is a Continuation Application of U.S. patentapplication Ser. No. 15/443,743 filed on Feb. 27, 2017, which is aContinuation Application of U.S. patent application Ser. No. 14/937,441,filed on Nov. 10, 2015, to issue as U.S. Pat. No. 9,602,867 on Mar. 21,2017, which is a Divisional Application of U.S. patent application Ser.No. 12/861,512, filed on Aug. 23, 2010, and claims priority under 35U.S.C. § 119(a) to Korean Patent Application No. 10-2009-0077877, filedin the Korean Intellectual Property Office on Aug. 21, 2009, and KoreanPatent Application No. 10-2010-0078783, filed in the Korean IntellectualProperty Office on Aug. 16, 2010, the contents of each of which areincorporated herein by reference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates generally to methods and apparatuses forrequesting and obtaining data, and more particularly, to a datarequesting apparatus including an image pickup unit and a method ofrequesting data using the data requesting apparatus, and a dataobtaining apparatus including an output unit and a method of obtainingdata by using the data obtaining apparatus.

2. Description of the Related Art

Due to the evolution of information technology, communication between atleast two devices has become a normal occurrence. In addition, a homenetwork has been realized, in which data or control commands may betransmitted between devices.

The home network enables efficient data sharing in that contents storedin one device can be used by another device, and functions provided inone device can also be provided in another device, and thus variousfunctions may be used.

However, absent in the prior art is an efficient apparatus and methodfor data requesting and data obtaining in a home network. For example,when a data obtaining apparatus is a TeleVision that outputs sixty (60)image frames per second, it is difficult for a data obtaining apparatusin the prior art to accurately search for the desired data by only usingtime information.

SUMMARY OF THE INVENTION

In order to solve the foregoing problems in the prior art, one thepresent invention provides methods and apparatuses for requesting andobtaining data in a home network.

According to an aspect of the present invention, there is provided adata requesting method performed in a first device, the method includingestablishing communication with a second device, the second deviceconfigured to display multimedia data on a screen of the second device;transmitting, by the first device, a request for data related to themultimedia data displayed in the second device towards the seconddevice, the request including information for identifying the data; andreceiving, from the second device, the data related to the multimediadata, the data related to the multimedia data transmitted in response tothe request, with the information for identifying the data beinggenerated in the first device while the multimedia data is displayed onthe screen of the second device, and with the first device being capableof displaying the data related to the multimedia data.

According to another aspect of the present invention, there is provideda first device that comprises a communication interface, at least onememory for storing instructions, and at least one processor configuredto execute the instructions to at least establish communication with asecond device configured to display multimedia data on a screen of thesecond device, transmit a request for data related to the multimediadata displayed in the second device towards the second device, with therequest including information for identifying the data, and receive,from the second device, the data related to the multimedia data, thedata related to the multimedia data transmitted in response to therequest, with the information for identifying the data being generatedin the first device while the multimedia data is displayed on the screenof the second device, and with the first device being capable ofdisplaying the data related to the multimedia data.

BRIEF DESCRIPTION OF THE DRAWINGS

The above and other features and advantages of the present inventionwill become more apparent by describing in detail embodiments thereofwith reference to the attached drawings in which:

FIG. 1 illustrates a data obtaining system according to a firstembodiment of the present invention;

FIG. 2 illustrates a data obtaining system according to a secondembodiment of the present invention;

FIG. 3 illustrates an operation of obtaining data according to anembodiment of the present invention;

FIG. 4 illustrates a network system according to an embodiment of thepresent invention;

FIG. 5 illustrates a data obtaining system according to an embodiment ofthe present invention;

FIG. 6 illustrates an example of an operation mode of a data requestingapparatus according to an embodiment of the present invention;

FIG. 7 illustrates a data structure of a data request command, accordingto an embodiment of the present invention;

FIG. 8 illustrates a method of requesting data, according to anembodiment of the present invention; and

FIG. 9 illustrates a method of obtaining data, according to anembodiment of the present invention.

DETAILED DESCRIPTION OF THE INVENTION

Hereinafter, embodiments of the present invention will be described withreference to the accompanying drawings. In the following description,the same elements will be designated by the same reference numeralsalthough they are shown in different drawings. Further, in the followingdescription of the present invention, a detailed description of knownfunctions and configurations incorporated herein will be omitted for thesake of clarity and conciseness.

FIG. 1 illustrates a data obtaining system according to a firstembodiment of the present invention.

Referring to FIG. 1, the data obtaining system 100 includes a datarequesting apparatus 110 and a data obtaining apparatus 120.

The data requesting apparatus 110 communicates with other apparatusesand may be, for example, a remote controller, a mobile phone, a camera,or a camcorder. The data obtaining apparatus 120 includes an output unitfor outputting data and may be, for example, a TeleVision (TV), acomputer, a Personal Digital Assistant (PDA), or a mobile phone.

The data requesting apparatus 110 includes a time information-generatingunit 112, a request command-generating unit 114, and a transmitter 116.

The time information-generating unit 112 generates time information thatis necessary for requesting data. A time of the data requestingapparatus 110 is preferably synchronized with a time of the dataobtaining apparatus 120.

The time information-generating unit 112 generates time information of atime point when a user input is received via an interface unit (notshown) of the data requesting apparatus 110. For example, when the datarequesting apparatus 110 is a remote controller, the button of which auser presses, the time information-generating unit 112 generates timeinformation of a time point when the button is pressed. In anotherexample, when the data requesting apparatus 110 is a camera, and a userpresses a button to activate the camera shutter, the timeinformation-generating unit 112 generates time information of a timepoint when the shutter is pressed.

The request command-generating unit 114 generates a data requestcommand, which includes the time information generated by the timeinformation generating unit 112, and is used to request for data outputby the data obtaining apparatus 120 at a time point indicated by thetime information.

The data request command includes any type of data that is needed tospecify data requested by the data requesting apparatus 110.

For example, the data request command includes image data of an outputunit 122 of the data obtaining apparatus 120 obtained by photographingthe output unit 122 when data is output by the output unit 122. Also,when data is to be transmitted to a third device, the data requestcommand includes identification of the third device to which data is tobe transmitted. An example of the data request command will be describedlater with reference to FIG. 7.

The transmitter 116 transmits a data request command. When image datathat is obtained by photographing the data obtaining apparatus 120 isnot included in the data request command, the transmitter 116 separatelytransmits the obtained image data. The transmitter 116 transmits thedata request command to the data obtaining apparatus 120 or an externalserver (not shown).

The data requesting apparatus 110 further includes a receiver (notshown) which receives data from the data obtaining apparatus 120 or anexternal server (not shown). The receiver receives a plurality of piecesof data that are output by the output unit 122 of the data obtainingapparatus 120 within a period of time from a time point indicated by thetime information. When the data obtaining apparatus 120 is a TV thatoutputs sixty (60) image frames per second, it is difficult for the dataobtaining apparatus 120 to accurately search for data desired by thedata requesting apparatus 110 just by using the time information. Inorder to solve this problem, the data obtaining apparatus 120 searchesfor a plurality of pieces of data output by the output unit 122 within aperiod of time from a time point indicated by the time information andtransmits the pieces of data to the data requesting apparatus 110 sothat the user may obtain desired data.

The data obtaining apparatus 120 includes the output unit 122, areceiver 124, and an obtaining unit 126.

The output unit 122 outputs data, and includes at least an image outputunit for outputting image data (e.g., a Liquid Crystal Display (LCD),not shown) or a voice output unit for outputting voice data (e.g., aspeaker, not shown). The receiver 124 receives a data request commandincluding time information from the data requesting apparatus 110.

The obtaining unit 126 obtains data output by the output unit 122, basedon time information, at a time point indicated by the time information.When the data output by the output unit 122 is stored in the dataobtaining apparatus 120, the obtaining unit 126 searches for the storeddata to obtain data desired by the data requesting apparatus 110. Whenthe data output by the output unit 122 is not stored in the dataobtaining apparatus 120 or data desired by the data requesting apparatus110 does not exist after searching for the same, the obtaining unit 126requests the external server for data.

The obtaining unit 126 includes a plurality of pieces of data that areoutput by the output unit 122 within a period of time from a time pointindicated by the time information and transmits the pieces of data tothe data requesting apparatus 110.

FIG. 2 illustrates a data obtaining system 200 according to a secondembodiment of the present invention, and describes an example in which adata requesting apparatus 210 including an image pickup unit 212requests data.

The data requesting apparatus 210 includes the image pickup unit 212, atime information-generating unit 214, a request command-generating unit216 and a transmitter 219. The image pickup unit 212 forms an image of asubject. The time information-generating unit 214 generates timeinformation indicating time when the image pickup unit 212 forms animage of the subject. The request command-generating unit 216 includes amode-determining unit 217 and a generating unit 218.

The mode-determining unit 217 determines an operation mode of the datarequesting apparatus 210, which is variable. For example, the operationmode may be divided into a photographing mode and a capture mode. Thephotographing mode is used to photograph a subject of which an image isformed on the image pickup unit 212, and the capture mode is used torequest a device, the image of which being formed on the image pickupunit 212.

For example, when the data requesting apparatus 210 is in thephotographing mode, and the image pickup unit 212 forms an image of aTV, image data of the TV is obtained. When the data requesting apparatus210 is in the capture mode, and the image pickup unit 212 forms an imageof the TV, image data output by the TV is requested to the TV (or anexternal server).

The mode-determining unit 217 determines an operation mode of the datarequesting apparatus 210 according to various standards. Hereinafter,three standards for determining an operation mode of the data requestingapparatus 210 will be described, but the standards are not limitedthereto.

According to a first embodiment, the user is induced to set an operationmode of the data requesting apparatus 210. When power is applied to thedata requesting apparatus 210, or when the image pickup unit 212 formsan image of a subject, an inquiry window is output so that the user mayset an operation mode of the data requesting apparatus 210.

According to a second embodiment, the mode-determining unit 217 analyzesthe subject, an image of which is formed by the image pickup unit 212 todetermine the operation mode of the data requesting apparatus 210. Whenthe subject photographed by the image pickup unit 212 includes theoutput unit 222, the operation mode of the data requesting apparatus 210is determined as a capture mode. If strict standards are applied, theoperation mode of the data requesting apparatus 210 is determined as acapture mode only when the image pickup unit 212 forms an image of theoutput unit 222.

According to the second embodiment, it is assumed that the operationmode of the data requesting apparatus 210 is determined as a capturemode only when the image pickup unit 212 forms an image of the outputunit 222, but according another embodiment, the operation mode of thedata requesting apparatus 210 may be determined as a capture mode alsowhen the user does not press a shutter, which indicates that a subjectis not being photographed.

According to a third embodiment, when set conditions are satisfied, theoperation mode of the data requesting apparatus 210 is determined as acapture mode. For example, when the data requesting apparatus 210 and adata obtaining apparatus 220 are connected via a communications network,and the output unit 222 is focused to the image pickup unit 212 for aperiod of time or longer, the operation mode of the data requestingapparatus 210 is determined as a capture mode.

As described above, by setting an apparatus providing functions so as tooperate in a capture mode under set conditions, the number of devices towhich the methods of the present invention may be applied may beincreased.

The operation mode of the data requesting apparatus 210 will bedescribed in detail later with reference to FIG. 4.

When the operation mode of the data requesting apparatus 210 isdetermined as a capture mode, the generating unit 218 generates a datarequest command as described above. That is, when the operation mode ofthe data requesting apparatus 210 is a photographing mode, thegenerating unit 218 generates a data request command only when theoperation mode of the data requesting apparatus 210 may be determined asa capture mode, instead of generating a data request command.

Image data of the data obtaining apparatus 220 formed by the imagepickup unit 212 is included in a data request command. When desired datais output by the output unit 222 of the data obtaining apparatus 220,the user photographs the output unit 222 by using the image pickup unit212. The generating unit 218 inserts the image data obtained byphotographing the output unit 222 into a data request command, therebyenabling a simple search of data for the data requesting apparatus 220.

The transmitter 219 transmits the data request command to a receiver 226in the data obtaining apparatus 220. When the data requesting apparatus210 and the data obtaining apparatus 220 are directly connected to eachother as illustrated in FIG. 2, the transmitter 219 transmits the datarequest command to the data obtaining apparatus 220. However, when thedata requesting apparatus 210 and the data obtaining apparatus 220 areconnected via a server 410 as illustrated in FIG. 4, the transmitter 219transmits the data request command to the server.

The data obtaining apparatus 220 includes the output unit 222, a storageunit 224, the receiver 226, and an obtaining unit 228. The output unit222 outputs data, the storage unit 224 stores the output data, and thereceiver 226 receives a data request command from the data requestingapparatus 210.

The obtaining unit 228 obtains the data output by the output unit 222 ata time point indicated by the time information. The obtaining unit 228obtains data in the data obtaining apparatus 220 or from the externalserver.

The obtaining unit 228 includes a search unit 229 when the obtainingunit 228 obtains data in the data obtaining apparatus 220.

The search unit 229 searches for data stored in the storage unit 224based on the time information included in the data request command. Whenthe image data of the data obtaining apparatus 220 is included in thedata request command, the search unit 229 compares the image dataincluded in the data request command with the stored image data.

When the obtaining unit 228 obtains data from the external server, theobtaining unit 228 includes a requesting unit (not shown) and a receiver(not shown).

The requesting unit determines which data is output by the output unit222 at a time point indicated by the time information based on the timeinformation included in the data request command. The requesting unittransmits data that is needed to specify the output data to the externalserver (not shown). For example, the requesting unit may transmit dataidentification information (e.g., identifiers of contents, or programidentifiers) and a frame number (or time information) of requested datato the external server (not shown).

The requesting unit receives data in response to a request of therequesting unit.

FIGS. 3A through 3C illustrate an operation of obtaining data accordingto an embodiment of the present invention. In FIG. 3, a data requestingapparatus is a mobile phone 310 including a camera, and a data obtainingapparatus is a desktop computer 320 having a display unit.

In FIG. 3A, the user photographed the desktop computer 320 by using thecamera included in the mobile phone 310. The mobile phone 310 generatesa data request command including time information indicating aphotographing time, and transmits the data request command to thedesktop computer 320.

In FIG. 3B, the desktop computer 320 obtains image data output by thedisplay unit thereof at the time point indicated by the timeinformation. The desktop computer 320 may obtain data requested by themobile phone 310 by capturing a screen output on the display unit or bysearching a storage space of the desktop computer 320.

In FIG. 3C, the mobile phone 310 receives image data from the desktopcomputer 320.

FIG. 4 illustrates a network system 400 according to an embodiment ofthe present invention.

In the network system 400, the data requesting apparatus 110 and thedata obtaining apparatus 120 are connected via the server 410. However,a peripheral device 420 is directly connected to the data obtainingapparatus 120.

The data requesting apparatus 110 and the network system 400 may be asmall-size network such as a home network system, a large-size networksuch as a High-Speed Downlink Packet Access (HSDPA), or a Wibro network.Both the data requesting apparatus 110 and the data obtaining apparatus120 may be registered to the server 410, and are able to communicatewith each other only inside the network system 400. However, the dataobtaining apparatus 120 may communicate directly with the peripheraldevice 420.

FIG. 5 illustrates a data obtaining system according to an embodiment ofthe present invention.

In operation S510, the data requesting apparatus 110 generates a datarequest command including time information. The data request commandrequests for data output by the output unit 122 of the data obtainingapparatus 120 at a time point indicated by the time information.

In operation S520, the data requesting apparatus 110 transmits the datarequest command to the data obtaining apparatus 120.

In operation S530, the data obtaining apparatus 120 searches a databasefor the data output by the output unit of the data obtaining apparatus120 at the time point indicated by the time information.

In operation S542, the data obtaining apparatus 120 requests an externalserver 502 for data that is requested by the data requesting apparatus110.

In operation S544, the data obtaining apparatus 120 receives the datarequested by the data requesting apparatus 110 from the external server502.

Operations S542 through S544 may not be performed when desired data isdetected in operation S530.

In operation S552, the obtained data is transmitted to the datarequesting apparatus 110. When a peripheral device 501 to which theobtained data is to be transmitted is designated in the data requestcommand, operation S554 is performed. In operation S554, the dataobtaining apparatus 120 transmits the obtained data to the peripheraldevice 501.

FIG. 6 illustrates examples of an operation mode of a data requestingapparatus 210 according to an embodiment of the present invention. TheTable illustrated in FIG. 6 may be displayed when the user requests forinformation regarding the operation mode of the data requestingapparatus 210.

The data requesting apparatus 210 operates in one of a photographingmode 610, a capture mode 620, a search mode 630, and an additionalinformation obtaining mode 640, and the user may modify a mode bymanipulating a scroll or a touch screen attached to the data requestingapparatus 210. According to embodiments, buttons corresponding to eachof the modes may be attached on a surface of the data requestingapparatus 210 so that modes are changed upon pressing a desired button.

In this specification, it is assumed that the user sets an operationmode and then presses an operation-initiating button, such as a camerashutter, and the data requesting apparatus 210 operations in the setmode. However, the data requesting apparatus 210 may operate in a modethat is concurrently set when an image is formed on the image pickupunit 212 or when the user presses one of the buttons corresponding tothe modes.

In the photographing mode 610, a subject is photographed and an image ofthe subject is formed on the image pickup unit 212. While the operationmode of the data requesting apparatus 210 is set as the photographingmode, the user presses the operation-initiating button, and the imagepickup unit 212 obtains data of the image of the subject that is formedon the image pickup unit 212. For example, while an image of a TV isformed on the image pickup unit 212, the user presses theoperation-initiating button, and thus image data of the TV is obtained.

In the capture mode 620, data output by a device of which an image isformed on the image pickup unit 212 is requested. While the operationmode of the data requesting apparatus 210 is set as the photographingmode, the user presses the operation initiating button, and thus a datarequest command for requesting data output by an output unit of asubject at a time point when the operation initiating button is pressedis generated. For example, while an image of a TV is formed on the imagepickup unit 212, the user presses the operation-initiating button, andthus a request command for requesting data output by the TV isgenerated. The TV that has received the request command obtains therequested data and transmits the same to the data requesting apparatus210.

In the search mode 630, a search is performed for information related toobjects or characters of which an image is formed on the image pickupunit 212. While the operation mode of the data requesting apparatus 210is set as the search mode 630, the user presses the operation-initiatingbutton, and thus the search is performed for information related toobjects or characters of which an image is formed on the image pickupunit 212. For example, while an image of a word ‘Star’ or an image of a‘Star’ relay is formed on the image pickup unit 212, the user pressesthe operation-initiating button, and thus information related to the‘Star’ is searched for with a search engine. A search range may bedetermined by the user in advance. The found information may betransmitted to the data requesting apparatus 210 or a peripheral device(not shown).

In the additional information-obtaining mode 640, metadata about dataoutput by a device of which an image is formed on the image pickup unit212 is obtained. While the operation mode of the data requestingapparatus 210 is set as the additional information obtaining mode 640,the user presses the operation-initiating button, and thus metadata ofdata output by a device of which an image is formed on the image pickupunit 212 is obtained. For example, while an image of a TV is formed onthe image pickup unit 212, the user presses the operation-initiatingbutton, and thus a requesting signal for requesting metadata about abroadcasting program output by the current TV is generated. A TV or abroadcasting server that has received the requesting signal obtains themetadata such as Electronic Programming Guide (EPG) information andtransmits the same to the data requesting apparatus 210 or stores thesame in the TV or the broadcasting server.

FIG. 7 illustrates a data structure of a data request command 700,according to an embodiment of the present invention.

The data request command 700 may include any information specifying datarequested by the data requesting apparatus 110.

The data request command 700 is formed of a command identifier 710, timeinformation 720, object area information 730, format information 740,and peripheral device information 750.

The command identifier 710 denotes types of the data request command700.

The time information 720 indicates a time point when desired data isoutput by the data obtaining apparatus 120. A time of the datarequesting apparatus 110 is preferably synchronized with a time of thedata obtaining apparatus 120. The data obtaining apparatus 120 detectswhich data is output at a time point indicated by the time information720 and searches for corresponding data. The object area information 730is information indicating desired data area. The data obtainingapparatus 120 may search for an image frame to be captured, based ontime information 720, and then capture a specific area within an imageframe based on object area information 730. The format information 740includes data format information desired by the data requestingapparatus 110. For example, the format information 740 may include atleast one of a data resolution, a data size, a data format, and encodinginformation.

The peripheral device information 750 indicates information aboutperipheral devices to which requested data is to be transmitted. Afterobtaining data requested by the data requesting apparatus 110, the dataobtaining apparatus 120 transmits the obtained data to a peripheraldevice indicated by the peripheral device information 750.

FIG. 8 illustrates a method of requesting data, according to anembodiment of the present invention.

In operation S810, a first device requesting data generates timeinformation that denotes a time point when a user input signal isgenerated, such as when the user photographs a subject or presses aninterface.

In operation S820, a data request command requesting data output by asecond device is generated at the point indicated by the timeinformation. The data request command may be generated when an operationmode of the first device is a capture mode.

The data request command may include image data of the second device,identification information of a third device to which requested data isto be transmitted, or other information. In operation S830, the firstdevice transmits the data request command to the second device.

FIG. 9 illustrates a method of obtaining data, according to anembodiment of the present invention.

In operation S910, a second device outputs data. In operation S920, thesecond device receives a data request command including timeinformation, from a first device. In operation S930, the second deviceobtains data output by the second device at a time point indicated bythe time information based on the time information.

The embodiments of the present invention can be written as computerprograms and can be implemented in general-use digital computers thatexecute the programs using a computer readable recording medium.

Examples of the computer readable recording medium include Read-OnlyMemory (ROM), Random-Access Memory (RAM), CD-ROMs, magnetic tapes,floppy disks, and optical data storage devices.

While this invention has been particularly shown and described withreference to embodiments thereof, it will be understood by those skilledin the art that various changes in form and details may be made thereinwithout departing from the spirit and scope of the invention as definedby the appended claims. The embodiments should be considered indescriptive sense only and not for purposes of limitation. Therefore,the scope of the invention is defined not by the detailed description ofthe invention but by the appended claims, and all differences within thescope will be construed as being included in the present invention.

What is claimed is:
 1. A method performed in a first device, the methodcomprising: establishing communication with a second device, the seconddevice configured to display multimedia data on a screen of the seconddevice; transmitting, by the first device, a request for data related tothe multimedia data displayed in the second device towards the seconddevice, the request including information for identifying the data; andreceiving, from the second device, the data related to the multimediadata, the data related to the multimedia data transmitted in response tothe request, wherein the information for identifying the data isgenerated in the first device while the multimedia data is displayed onthe screen of the second device, and wherein the first device is capableof displaying the data related to the multimedia data.
 2. The method ofclaim 1, the method further comprising: receiving a user input forcapturing an image of the multimedia data output in the second device;and generating the request in response to receiving the user input. 3.The method of claim 2, wherein the request includes the captured imageof the multimedia data output in the second device and time informationindicating a time at which the image was captured.
 4. The method ofclaim 3, wherein the multimedia data displayed in the second device isstored in the second device, and the data is searched by the seconddevice from the stored multimedia data based on the time informationincluded in the request.
 5. The method of claim 4, wherein the capturedimage included in the request is used by the second device for searchingfor the data.
 6. The method of claim 1, wherein the request furtherincludes information about a third device to which the data is to betransmitted.
 7. The method of claim 3, wherein the received dataincludes a plurality of frames of the multimedia data displayed in thesecond device, and the plurality of frames of the multimedia data areobtained, by the second device, within a period of time from the timeindicated by the time information.
 8. The method of claim 1, wherein therequest is generated in a predetermined operating mode among a pluralityof operating mode in which a capturing apparatus in the first device isused.
 9. The method of claim 8, wherein the predetermined operating modeis a mode for requesting the data displayed in the second device whichis captured by the capturing apparatus.
 10. The method of claim 1,wherein the method further comprises: transmitting the request for datarelated to the multimedia data to an external server.
 11. A first devicecomprising: a communication interface; at least one memory for storinginstructions; and at least one processor configured to execute theinstructions to at least: establish communication with the seconddevice, the second device configured to display multimedia data on ascreen of the second device, transmit a request for data related to themultimedia data displayed in the second device towards the seconddevice, the request including information for identifying the data, andreceive, from the second device, the data related to the multimediadata, the data related to the multimedia data transmitted in response tothe request, wherein the information for identifying the data isgenerated in the first device while the multimedia data is displayed onthe screen of the second device, and wherein the first device is capableof displaying the data related to the multimedia data.
 12. The firstdevice of claim 11, wherein the first device further comprises: acapturing apparatus, wherein the at least one processor is furtherconfigured to execute the instructions to: receive a user input forcapturing an image of the multimedia data output in the second device;and generate the request in response to receiving the user input. 13.The first device of claim 12, wherein the request includes the capturedimage of the multimedia data output in the second device and timeinformation indicating a time at which the image was captured.
 14. Thefirst device of claim 13, wherein the multimedia data displayed in thesecond device is stored in the second device, and the data is searchedby the second device from the stored multimedia data based on the timeinformation included in the request.
 15. The first device of claim 14,wherein the captured image included in the request is used by the seconddevice for searching for the data.
 16. The first device of claim 11,wherein the request further includes information about a third device towhich the data is to be transmitted.
 17. The first device of claim 13,wherein the received data includes a plurality of frames of themultimedia data displayed in the second device, and the plurality offrames of the multimedia data are obtained, by the second device, withina period of time from the time indicated by the time information. 18.The first device of claim 11, wherein the request is generated in apredetermined operating mode among a plurality of operating modes inwhich a capturing apparatus in the first device is used.
 19. The firstdevice of claim 18, wherein the predetermined operating mode is a modefor requesting the data displayed in the second device which is capturedby the capturing apparatus.
 20. At least one non-transitorycomputer-readable recording medium for storing a computer programconfigured to be readable by at least one processor to instruct the atleast one processor to execute a computer process for performing themethod of claim 1.